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We study a maturity randomization technique for approximating 
optimal control problems. The algorithm is based on a sequence of 
control problems with random terminal horizon which converges to 
the original one. This is a generalization of the so-called Canadization 
procedure suggested by Carr [Review of Financial Studies II (1998) 
597-626] for the fast computation of American put option prices. 
In addition to the original application of this technique to optimal 
stopping problems, we provide an application to another problem 
in finance, namely the super-replication problem under stochastic 
volatility, and we show that the approximating value functions can 
be computed explicitly. 

1. Introduction. It is well known that the arbitrage-free price of an 
American put in a complete market is the value of an optimal stopping prob- 
lem, which corresponds in a Markov framework to a free boundary problem. 
For a finite horizon, no explicit formula for this value is known in general. 
An explicit solution does exist in the infinite-horizon case when the reward 
process is defined by a Levy process; see, for example, [10]. 

The maturity randomization technique introduced by Carr [2] provides an 
interesting algorithm for the computation of a finite-horizon optimal stop- 
ping problem by passing to a sequence of infinite-horizon stopping problems. 
This technique is well established in the literature, and is referred to as the 
Canadization procedure; see, for example, [9]. We shall review this technique 
in Section 2. 

However, the original paper of Carr [2] does not report a proof of con- 
sistency of this technique. Instead, there is an intuitive discussion of the 
theoretical foundations of the algorithm through appeal to the dynamic 
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programming principle. Although this argument seems to be very intuitive, 
it does not apply to this particular context, as the random times introduced 
in the maturity randomization algorithm are independent of the filtration 
relative to the class of stopping times. The numerical evidence provided in 
[2] shows the excellent performance of this method. 

In this paper we extend this approach to general finite-horizon stochastic 
control problems, including optimal stopping problems. The consistency of 
the algorithm is proved in this general framework. These results are con- 
tained in Section 3, and the application to optimal stopping problems is 
reported in Section 4. We conclude the paper by studying an example of 
stochastic control problem from finance, namely the problem of hedging in 
the uncertain volatility model. The value function of this problem can be 
characterized as the unique solution of a fully nonlinear partial differential 
equation. Applying the maturity randomization technique in this context, 
we are reduced to a sequence of nonlinear ordinary differential equations 
that can be solved explicitly. 

2. Solving the American put problem by maturity randomization. In 

this section we review the numerical procedure suggested by Carr [2] for a 
fast numerical computation of the American put price. Let ($7,^, P) be 
a complete probability space supporting a real-valued Brownian motion 
W = {W{t),t> 0}. We denote by F = {J't, t > 0} the F-completion of the 
canonical filtration of W. 

For every t>0, the set is the collection of all F-stopping times t >t 
P-a.s. 



2.1. The American put problem. Let S be the process defined by 

^2- 



= 5(0)exp 



t + aW{t) 



t >0, 



where S{0) is some given initial data, and r, a > are given parameters. 
The main purpose of [2] is to compute the value of the following optimal 
stopping problem: 



(2.1) 



Vo:= sup E[e-^(^^'^)5(5(rAr))], 
rero(F) 



where T > is some given finite horizon, and 

g{x) := [K — x]~^ for some positive constant K. 

We introduce the so-called Snell envelope of the reward process 
{e-^(*^^)5(5(t AT)), t>0}: 

Vit) := ess-supE[e-'^(^^^)(7(S(T A T))\Tt], 
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whose analysis provides a complete characterization of the solution of (2.1). 
Prom the Markov property of the process S, the above Snell envelope can 
be written as 

V{t) = v{t,S{t)) forallt>0, 

where v is the value function of the dynamic version of the optimal stopping 
problem (2.1): 

v{t,x):= sup E[e-''^^^^^g{S{TAT))\S{t)=x]. 

2.2. Maturity randomization. The main idea of [2] is to reduce the prob- 
lem of computation of Vb to a sequence of infinite-horizon optimal stopping 
problems, which are well known to be easier to solve. Indeed when T = -|-oo, 
it follows from the homogeneity of the process 5 that the dependence of the 
value function v on the time variable is given by 

v{t,x)=e''*v{Q,x) for all (t,x) GM^, 

and the problem reduces to finding the dependence of v on the x variable. In 
many instances, this dependence can be found explicitly. We now describe 
Carr's procedure in different steps. 

Step 1 . A sequence of infinite-horizon optimal stopping problems is cre- 
ated by approximating the fixed finite maturity T by a sequence of random 
variables. Let {i^)k>o be a sequence of random variables satisfying the fol- 
lowing requirements: 

(2.2) are i.i.d. nonnegative random variables with E[^'^] = 1, 

(2.3) is independent of F for every A; > 0. 
By the law of large numbers, it follows from (2.2) that 

n 

i=i 

It is then natural to introduce the approximation 

vn{x):= sup E[e-'-(^^^")5(5(TAr„"))|5(0)=x]. 

TeTo{¥) 

In the sequel, we shall need the extended notation 

v':ix):= sup E[e-^(-^^")<7(S(TAX„^))|5(0)=x], 

tGTo(F) 

where 

T!::=-Y,e for k<n, 
and we observe that v"^ = Vn- 
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Step 2. We next observe that 



T^ = Tt' + Cl where C^=-e^ 

n 



and we use property (2.3) of the random variables {^^) to write 



vi{x)= sup E[e-^(-^^'^)5(5(TAT„^'))l{,<^.} 



+ e-(-^^")5(5(r A r„^))l|,>^.} |5(0) = x] 

= sup E[e"^^5(5(T))G:;(T) 
rero{F) 

where 

G^(i):=IP[d'>t]- 

3. By a formal argument, Carr claims that the latter supremum 
can be written as 

vi{x)= sup E[e--ff(S(T))G^(r) 
TGro(F) 

(2.4) 

+ e-<"«ri(5(C^'))l{,>^.||5(0) = x]. 

Let us point out that Carr fully recognizes that he is not providing a rigorous 
proof for the convergence of the scheme. We shall elaborate further on this 
point later on, but let us only observe that, at a first glance, this equality 
seems to follows from 

(i) the classical dynamic programming principle, 

(ii) the homogeneous feature of the problem. 

Step 4. Using again the fact that C,^ is independent of F, the above 
formula (2.4) can be written as 

v^^{x)= sup ¥\e-^-g{S{T))Gi{T)- r e-^'vi-\S{t))dGi{t)S{G)=x 

rGro(F) L Jo 

Finally, fix the distribution of ^* to be exponential with unit parameter. 
Then 

G^(i) = e-"*/^ foralH>0, 
and we obtain the following recursive formula: 



(2.5) vi{x)= sup E 

tGTo(F) 



'g{S{T)) + ^ j\-^-'vt\S{t))dt\s{Q)=x 



MATURITY RANDOMIZATION 



5 



where we defined the parameter 

n 

rn :=r + -. 

Step 5. In the case of the American put option, Carr was able to write a 
beautiful explicit formula which relates to v^~^; that is, given the function 
Vn~^, the optimal stopping problem (2.5) is solved explicitly. Together with 
the use of the Richardson extrapolation technique, this produces a fast and 
accurate approximation of the American put option value. 

2.3. Consistency and extension to general control problems. The first 
objective of this paper was to provide a rigorous proof of consistency for 
the scheme described in the previous paragraph. This opened the door for 
a much larger generality of this technique. 

Our first attempt for the proof of consistency is to justify the crucial 
equality (2.4). Unfortunately, the dynamic programming principle does not 
apply in this context, as is independent of the filtration F. Our first main 
result is that, although this equality may not hold, the scheme suggested by 
Carr by the recursive formula (2.5) is consistent. The proof is provided in 
Section 4.2. 

In Section 4 the above result is established for general optimal stopping 
problems, thus dropping the Markov and the homogeneity assumptions on 
the reward process. The random variables are also allowed to have differ- 
ent distributions. This could be exploited as an error reduction factor. We 
leave this point for further research. 

In Section 3 we prove that the maturity randomization technique applies 
to general stochastic control problems, and mixed stopping/control prob- 
lems. 

We conclude the paper by providing another interesting example where 
the maturity randomization technique leads to an explicit recursive relation. 
The example studied in Section 5 consists in the problem of hedging a Euro- 
pean contingent claim in the context of the uncertain volatility model, that 
is, the diffusion coefficient is only known to lie in between two bounds. 

3. Approximating control problems by maturity randomization. 

3.1. The control problems. We now consider a general probability space 
{Q,A,F) endowed with a filtration F = {J-'t}t>o satisfying the usual condi- 
tions, and we assume that J-'q is trivial. Importantly, we do not assume that 
A = J-Qo in order to allow for other sources of randomness. 

Given a set U of (deterministic) functions from ]R_|. to M'^, d> 1, we denote 
by U{¥) the collection of all F-adapted processes v such that 

1 1 — > z^(t, Lo) for almost every w G fi. 
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The controlled state process is defined by a map 

V G Ui^) I — > y'' G L}^(M+ X Jl, M), 

where L^(M+ x is the set of all F -progressively measurable processes 

valued in M, and 

(3.1) ^'(O) =: y(0) is independent of v. 

The set Z//(F) of F-admissible control processes is a subset of the collection 
of elements v G Z//(F). We assume that this set of controls is stable under 
bifurcation at deterministic times, that is, 

(HW) For all vx,V2^ U{¥),t > and AeT, 

z^i = 1/2 on [0,t) P-a.s. =^ i/i|tA|i^2 := z^i^-A + t'2lA<: G ^(F). 

Notice that this condition is slightly weaker than the stability by bifurcation 
at stopping times introduced in [5]. 

Remark 3.1. Assumption (H.U) is weaker than the usual stability under 
concatenation property: 

(RUy For all ui, U2 e U{¥) and r G To(F), z/ilp.r) + i^2l[r,oo) G ^(F), 

which is not satisfied for the optimal stopping problems studied in Section 
4. In Section 3.3, we shall use a weak version of (HW)': 

{WAf For all ui, G U{¥) and t > 0, z^ilp,*) + i'2l[t,oo) G Z^(F). 
We are interested in computing 

(3.2) sup E[y^(r)]. 

Following the maturity randomization technique of [2], we introduce a se- 
quence of approximating control problems. We denote by the collection 
of all nonnegative random variables which are independent of Too, that is, 

E[^]1a] = P[^]E[^] for any A G Too- 

Given some integer n > 1, we next consider a sequence (C"')i<i<n of inde- 
pendent random variables in , and we set 

k 

rpk ._ for 1 < A; < n, r° := 0. 

i=i 

We denote by m the law of {C^, . . . , C") under P, that is, 
7n{Ai X •••X A„)=P[C^GAi,...,r G A] 

n 

= Y[ m^{Aj) for aHAi,...,An£ ^r+, 
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where denotes the Borel tribe of M4, , and denotes the law of C'' ■ 
The maturity randomization algorithm is defined as follows: 

(3.3) Vq^ = Y'', ueU{¥), 
and for /c = 0, . . . , n — 1 

(3.4) V,\,it) = ess-sup E[V,^{t + C""')!^*], t > 0, 

^ieu(¥■,t,u) 

where is an (O x M+, .7^ Cg) ^Sr^) -measurable aggregating process for 
[see assumption (HV) below], and 

U{¥; t, u) := {i^l £ U{¥) : = z> on [0, t) P-a.s.}. 

In order to give a sense to the above expressions, we assume that 

(HY) There is a uniformly integrable martingale such that, for each 

V G U{¥), \Y''{t)\ < M^{t) for ah t > P-a.s. 
(HV) For each v £ U{¥) and 1 < /c < n -1, there is an {fl x M+, JT ® ^k^)- 

measurable process such that Vi^{t) = Vj^{t) P-a.s. for all t > 0. 

Remark 3.2. Assumption (HY) implies that, for each G U{¥) and 
< A; < n, |V'^''(t)| < M^{t) P-a.s. for ah t > 0. Indeed, assume that the as- 
sertion is true for some < k < n. Since ^""'^ is independent of using 
Fubini's lemma in (3.4) leads to 

V,\,{t)< ess-sup E[\V,^{t + C-''m] 

lJL&U{¥;t,u) 

= ess-sup [¥[\V^{t + z''-^)\\J^t]m{dz) 

< I E[M^ {t + z''-'')\J^t]m{dz) 

= M^{t), P-a.s. 

The same argument also shows that the expectations in (3.4) are well de- 
fined. 

Remark 3.3. (i) Assumption (HV) is necessary since V^{t + ("'~^) may 
not be defined as a measurable map from into M. 

(ii) Observe that Vq = Vq from the conditions on the controlled process 

(iii) In the usual literature on stochastic control (see, e.g., [5]), (3.4) is 
shown to define a supermartingale family, as a consequence of the stability 
by bifurcation property. This is the key point in order to prove the existence 
of a ladlag aggregating supermartingale. Unfortunately, these results do not 
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apply in our framework. Indeed, the time t appears on the right-hand side 
of (3.4) both in the controlled process and in the conditioning, so that the 
problem (3.4) does not fit in the classical class of stochastic control problems. 

(iv) In Sections 3.3 and 4.2 we shall provide sufficient conditions ensur- 
ing the existence of a ladlag modification of . This will be obtained by 
assuming an exponential distribution for the maturity randomizing random 
variables C^, and observing that (3.4) reduces, in this case, to a classical 
stochastic control problem. 

Remark 3.4. For later use, notice that, under assumption (HU), for 
t2 > ii > and G U{¥) 

Since U{¥;0,i') = U{¥), we shall simply write 
(3.5) Vfc(O) := ^^''(O) for k < n. 

3.2. The convergence result. We start with the following easy lemma 
which will be used later to derive an upper bound for V^(0). 

Lemma 3.1. Under assumptions (HY), (HV) and (HU), for all k>0, 
t>0, veU{¥), 



E 

In particular, 



ess-sup ¥[V^{t + C~n\:Ft] 

fieU{¥;t;u) 



sup ¥[V,^{t + C-% 



¥[V,\,{t)]= sup ¥[V,^{t + C-% 



Proof. Under assumption (HU), the family 

{¥[V,^{t + C-')\Tt],^^eU{¥■,t■,u)} 
is directed upward. We can then find a sequence fij G U{¥;t; u) such that 
ess-sup ¥[V^{t + C~^)\Tt] = lim T ¥[Vl!' [t + C~^)\Tt], P-a.s. 

fM€U{F;t;u) 

By the monotone convergence theorem, this implies that 

^•n—k\ 

fieUiF;t;u) 

The converse inequality is obviously satisfied. The second statement of the 
lemma then follows from the definition of V^_^-^ in (3.4). □ 

We are now ready for the main result of this section. 



E 



ess-sup ¥[V^^{t + C~'')\^t] 

.fj,eUiF;t;u) 



< sup ¥[V,^it + C-% 
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Theorem 3.1. Let assumptions (HY), (HV) and (BU) hold. Then 
(3.6) sup E[y^(r")] < 1/„(0) < / sup Ki^iz^ + --- + z'')]m{dz). 

Proof. 1. We first prove the upper bound. Fix I < k <n — 1, v G Z//(F) 
and t > 0. Since CJ^~^ is independent of Too^ it follows from assumption (HY) 
and Remark 3.2 that we can use Fubini's lemma to get 

E[vr(i + r-'^)] = / + ^"-')]m(dz), 

where we use the notation z = (z^, . . . , z"). By Lemma 3.1, this can be 
written as 

E[F/r(t + r-')]= / sup E[F,'i,(t + z"-'= + C"^^+i)]m(dz). 

In view of Remark 3.4, the upper bound of Theorem 3.1 then follows from 
an easy induction. 

2. In order to provide the lower bound, we first show that for all v €U{¥): 

E[Vfc'^(r"-'=)] = E[v^{C-'' + r"-'=-i)] 

(3.7) 

<E[V,\,iT^-'-% k<n-l. 
Indeed, since {C^)k<n are independent random variables in , we have 

E[V^{C-^ + T''-''-^)]=E / V^{C~'' + t)dF{t) 

where F(t) := pl^j""-'^-! < ^] jg the cumulative probability distribution of 
rpn-k-i^ We next use Fubini's lemma together with the definition of in 
(3.4) to obtain 

E[Vj^iC~'' + T''-''-^)] = / E[E[Vi^{C~'' + t)\J^t]] dF{t) 

Jo 

< I E[F,!;i(t)]dF(t) 
E[V,'^,it)]dFit) 

By (3.3), (3.5), it follows by using repeatedly (3.7) that 

EiViT"')] = E[Vq^{T"')] < E[y„^(0)] = Vn{0). 

Since u is an arbitrary control in U{¥), this provides the lower bound an- 
nounced in Theorem 3.1. □ 
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We now consider sequences {{Cn)k<n}n>i of random variables in . 
We define the corresponding sequence {(yi^'^)k<n}n>i, where, for each n, 
{V^'"')k<n is defined as in (3.3), (3.4) with the sequence {Cn)k<n- For each 
n > 1, we define 

n 

•= V 

and we denote by m„ the law of (C^, . . . ,Cn)- Using the bounds of Theorem 
3.1, we can provide conditions under which F^(0) = V^^'"(0) converges to 
the value of the initial control problem (3.2). 

Corollary 3.1. Let assumptions (HY), (HV) and (RU) hold, and sup- 
pose that the triangular array (<^^) satisfies 

— > T £ (0, oo) in probability. 



(i) Assume that 

(3.8) t>Oi — ^ElY^it)] is continuous at t = T for all iyeU{¥). 

Then liminf„_^oo]E[y''(r^)] > E[y'^(r)] for all v G Ui^). 

(ii) Assume that 

(3.9) t>Oi — > sup E[y^(t)] is continuous at t = T. 

ueu{¥) 

Then limsup„^^ / sup^^^^^^) ElY^iz^ + • • • + z")]m„((i2) < sup^^if^^^ E[y''(T)] . 

(iii) Assume that (3.8) and (3.9) hold. Then 

hm K"(o)= sup E[y-(r)]. 

Proof. In view of Theorem 3.1, statement (iii) is a direct consequence 
of (i) and (ii). To see that (i) holds, we fix z/ £l/({¥) and let denote the 
cumulative distribution of T^. Let r/ > be an arbitrary parameter. From 
the continuity condition (3.8), it follows that |E[y''(t)] - E[y''(r)]| < ry for 
|T — t| < e for sufficiently small e > 0. Then, using Fubini's lemma together 
with the fact that the process is bounded from below by a uniformly 
integrable martingale, it follows that 

E[y''(r^)] > -CP[|T^ -T\>e]+ r^'ElVit)] dF'^{t) 

JT-e 

> -CP[|T^ -T\>e\ + (E[y'^(T)] - r/)P[|r^ - T| < e], 

for some real constant C > 0. Since T^ — > T in probability, we deduce (i) by 
sending n to oo and then r/ to zero. Statement (ii) is obtained by following 
the lines of the above arguments, using the continuity condition (3.9). □ 
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Remark 3.5. (i) The continuity assumptions (3.8), (3.9) have to be 
checked for each particular case; see, for example. Sections 4 and 5. 

(ii) If there is some optimal control u (F) for the problem sup^g^(]ir) 
E[y'^(T)], then it suffices to check condition (3.8) for z). 

(iii) The above proof provides an upper bound for the rate of convergence 
of . Given the uniform modulus of continuity at T: 

p{e):= sup sup |E[y^(t)]-E[y'^(T)]|, 

t&[T-e,T+e\v&A{¥) 



the above arguments indeed show that 



C(o) - sup E[y^(r)] 



<Cl 



T\>e\+: 



T\<e]p{e) 



for some real constant C > 0. Depending on p and T", we can then choose 
e according to n so as to minimize the right-hand side quantity. In general, 
p is not known precisely but it is often possible to provide an upper bound 
which can be plugged in to the above inequality. 

3.3. Exponential maturity randomization. In this section we assume that 
iCn)j<n is a sequence of exponentially distributed random variables with 
parameter > 0, for each n. In this case, (3.4) can be written as 



-Xnt 



Vl^_^i{t) = ess-sup E 
^l&u{¥■,t,u) 



t>0, 



so that the problem (3.4) is reduced to a classical stochastic control problem; 
see Remark 3.3. In this context, it suffices to assume that the bifurcation 
property (HZ^) holds at F-stopping times to obtain the existence of a mea- 
surable aggregating supermartingale; see [5]. 

For sake of completeness, we provide an easy proof of this result in the 
case where assumptions (HY), (HZY) and (HZY)" are combined with a lower 
semicontinuity condition on v h^¥,\Y'^{t)]. In this case, we can even find a 
cadlag aggregating supermartingale. 



Lemma 3.2. Let assumptions {HY)-(HU) hold, and suppose that U{¥) 
satisfies assumption (HU)" of Remark 3.1. Assume further that is a 
cadlag process for each v G Z//(F), and 



(3.10) 



liminfE[y''''-(t)] >E[y''(t)] 



whenever P[i/fc(t) — > u{t),yt > 0] = 1. 



Then, for each k <n and v G ^(F), we can find a cadlag supermartingale 
which aggregates in the sense of assumption (HV) . 
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Proof. Since Vj^ = on [0, t) for each /z G ^(F; t, v), we introduce the 
process 



M,-+i(t):=e-^"V,!;i(t) + A„ / V;:{u)e->'-^ du= ess-sup J,^+i(t), 



where 



An,/ ^^,'^(n)e 



(in 



We first show that the process M^_^_^ is a supermartingale for all u G U{¥) 
and A; > 0. Indeed, under assumption (HZ^), the family { J^^.^, fj, £U{¥; t, z/)} 
is directed upward. Then Mj^_^_^{t) = lim„_^oo T J^^iit) for some sequence 
(Mn)n>i C Z//(F;t, z^), and it follows from the monotone convergence theorem 
that for all s <t, 

E[Mj:^,{tm = Jim T E{4;,{tm = Jim T 

< ess-sup J^_j_^(s) =M^+i(s). 

We now turn to the proof of the statement of the lemma. We only show 
that Ml admits a cadlag modification, and that, for each t>0, 



(3.11) 



limmfEiMi" (t)] >E[M^{t)] 

fe— >oo 



whenever P[i/fc(t) — > u{t), t > 0] = 1. 



The required result will then be obtained by an induction argument. 

We first prove that the mapping 1 1— > E[M|'(t)] is right-continuous. Since 
is a supermartingale, this ensures that it admits a cadlag modification; 
see, for example, [4]. First observe that, by the same argument as in Lemma 
3.1, it follows from Assumption (H^) that 



(3.12) E[M]"(t)]= sup E 

AJeW(F;t,!/) 



This implies that E[M|'(t)] is nonincreasing in t. Hence, it suffices to show 
that 



(3.13) 



limE[M{'(s)] >E[M{'(t)]. 



To see this, fix e > and let /i^ G tl{¥'-, t, u) be such that 



(3.14) sup E 



Y^{u)e 



-\nU 



du 



<E 



+ e. 
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Let {tk)k>i be a sequence converging toward t, and such that tk > t, and 
define, for each A; > 1, 

By assumption (KU)" , ji^ G U{¥;tk,i^), so that by (3.12) 



E[M^itk)]>K 







Since /i^ — > /ig P-a.s., it follows from (3.10), (3.12), (3.14), Fatou's lemma. 
Remark 3.2 and Fubini's lemma that 

/•oo 

lim E[M^{tk)] > Hminf / A„E[y'^- {u)]e-^"'' du 

fc— >oo fc— >oo JO 

> / AnE[y''-(u)]e-^""dn 
Jo 

>E[M^{t)]-e. 

Sending e to then shows (3.13). 

Property (3.11) is easily deduced from (3.10) and (3.12) by using Fatou's 
and Fubini's lemmas as above. □ 

4. Application 1: optimal stopping. 

4.1. The general case. We now show that the optimal stopping problem 
presented in Section 2 can be embedded in the framework studied in the 
previous section. Let Z be an F-adapted process. We assume that Z is 
cadlag and bounded by a uniformly integrable martingale. The main object 
of this section is the optimal stopping problem: 

sup E[Z(TAr)]. 

Tero(F) 

In order to embed this problem in the general framework of the previous 
section, we follow [5] and set 

z^T-(t) := IrKt for each r £ To{¥). 

This defines a one-to-one correspondence between the set of stopping times 
7o(F) and the family 

^(F) ■.= {ur:T &%{¥)}. 

We shall denote by Ti, the stopping time associated to G U{¥). Observing 
that 

Z{t At)= Y-'-it) := f Z{u) dvriu) + Z(t)l,^(i)=o, 
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we see that the optimal stopping problem can be rewritten as 

(4.1) sup E[Z{tAT)]= sup KlY^iT)]. 

Remark 4.1. The set U{¥) satisfies assumption (HZ//) of Section 3. Also, 
for V G U{¥)^ t > and ^ € U{¥;t^u), we have = on {r^ < t}. On 
{tu >t},T^ can be any stopping time r G %{¥). However, assumption (HU)" 
is clearly not satisfied. 

Given a sequence (Cn)fe<rn we let V^^^'" be the associated sequence of con- 
trolled processes as defined in Section 3. Then, (3.3) reads as 

(4.2) Vo''''{t) = Z{T,At), t>0, 
and it follows from Remark 4.1 that 

Vrit)= ess-sup EiVrit + Cm 

/iGW(F;t,i/) 

= ess-sup E[Z(T^A(t + C))l-^i] 

/iGW(F;t,!/) 



where 



X^{t) := ess-supE[Z(r A (t + Cn))\^t], t > 0, 

does not depend on Ty. We next compute 

V^''^{t)= ess-sup EiVrit + Q-'m 

= ess-sup E[Z{T,)lr^^t + X^it + C~')U.>t\:Ft] 

= z{T,)u,^^t + x^{t)u^>u 

where 

X^{t) ■.= ess-snpE[Z{T)l^^^^.n-i+Xnt + C~^K>t+r'A^tl t>0, 

and X" denotes a measurable aggregating process which we assume to 
exist. More generally, given Xq := Z and 

X,\i(t) := ess-sup E[Z(r)l^^ „^. + X^t + C"')l,>t+c"-*l-^*]' 
(4.3) 

i>0 
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for 0<fc<n— 1, we observe the following relation between V^^'^ and XJ^: 

(4.4) V^^'^it) = Z{T,)tr^<t + Xl{t)tr^>u t > 0. 

In particular, 

(4.5) V:{0)=X:{0), 

and the sequence {XJ!{0))k<n corresponds to Carr's algorithm as described 
in Section 2, for a suitable choice of Z. 

We conclude this section with the following result which provides sufficient 
conditions for the convergence of the algorithm. 

Proposition 4.1. Assume that Z is cadlag and that assumption (HY) 
holds. Then, 

(4.6) limsup sup E[|Z(r A T) - Z(r A (T + e))|lT<^] = 0. 

£\o rero(F) 

In particular, if assumption (HV) holds and T" -^T in probability, then 
^n(O) — > sup K[Z{tAT)] asn — >oo. 

rgro(F) 

Proof. In view of (4.1)-(4.5), the second assertion is equivalent to 
K'(O) — > sup ElY^iT)] as 71 — >oo. 

Observe that (4.6) implies (3.8), (3.9) of Corollary 3.1, so that the latter 
convergence result follows from Corollary 3.1(iii). It remains to show that 
(4.6) holds. For e > 0, let E %(¥) be such that 

sup E[\Z{T)-Z{TA{T + e))\lT<r] 

< E[\Z{T) - Z{t' a (T + e))\lT<rA + £• 
Since Z is right-continuous, 

limsup|Z(T) - Z{t^ A {T + e))\lT<r^ = 0, P-a.s. 

By the uniform integrability condition on Z, which is implied by assumption 
(HY), we deduce that 

\Z{T) - Z{t^ A {T + e))\ <2sup\Z{t)\ e . 

In view of the previous equality, the result follows from the dominated con- 
vergence theorem. □ 
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4.2. The case of exponentially distributed random variables. In this sec- 
tion we discuss the case where, for each n, {Ci)j<n is a sequence of exponen- 
tially distributed random variables with parameter A„ > 0. Then, (4.3) can 
be written as 



ess-sup E 

reTtiW) 

(4.7) 



Z(T)e-^"^ + A„ r Xl{u)e-^-''du 
Jo 

e-^"*X^+i(t) + A„ [' Xj:{u)e-^-^du. 
Jo 



In the case where Z is cadlag and satisfies assumption (HY), we easily check 
that (HV) holds. In view of (4.4), this is implied by the next result. 

Lemma 4.1. Assume that Z is cadlag and that assumption (HY) holds. 
Then, for each n>k> 1, X"^ admits a cadlag aggregating supermartingale. 

Proof. Assuming that X^ is of class (D), we deduce that the process 

Jr(-) :=Z(-)e-^"- + A„ f X]:{u)e-^--du 

Jo 

is of class (D) too. By Propositions 2.26 and 2.29 in [5], we deduce that the 
family 

MJ}{t) := ess-sup E[J(r) I J^t] 
reri(F) 

can be aggregated by a supermartingale which is of class (D). The result 
then follows from (4.7) by induction. □ 

In [2], the author considers the case where Z{t) = e~'^*g{S{t)), t > 0, for 
some function g, and a lognormal process S defined by 



S{t) = S{0) exp 



-]t + aW{t) 



t >0, 



for some real constants r, a and a standard Brownian motion W. It is shown 
that there is a sequence {v^)k<n of bounded Lipschitz functions such that, 
for each k <n, 

Xl = vl{S). 

Here, X^ depends on time only through S. This is due to the time homo- 
geneity of the dynamics of S. 

For g with polynomial growth and A.„ = n, it is clear that the conditions 
of Proposition 4.1 are satisfied for this simple model. This shows the consis- 
tency of Carr's algorithm. 
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5. Application 2: hedging in the uncertain volatility model. 

5.1. Problem formulation. Let be a real-valued Brownian motion, on 
the probability space (r2,jF,P), and let F be the P-completion of the associ- 
ated canonical filtration. 

Given two constants < cJi < cj2, we define h({¥) as the collection of all 
F-predictable processes with 

(5.1) cTi < iy{-) < (72, P-a.s. 

For each control process v G U, the controlled state process dynamics is 
defined by 

(5.2) dX''{t)=X''{t)i^{t)dW{t), t>0. 

In this section we apply the maturity randomization technique to the stochas- 
tic control problem 

(5.3) v{0,x):= sup K{h{X''{T))\X''{0) = x] where /i:M+ — >R 

is some bounded function. Further conditions will be placed later on h in 
order to obtain an explicit maturity randomization algorithm. 

The financial motivation of this problem is the following. The process X'^ 
represents the price of some given risky asset at each time t. v \s called the 
volatility process of X^ and is only known to be bounded by two constants 
o"! and (T2- The financial market also contains a nonrisky asset with price 
process normalized to unity. The random variable h{X^{T)) is an example of 
European contingent claims. Then, v{Q,X^ [Q)) is the sharpest upper bound 
of all selling prices which are consistent with the no-arbitrage condition. We 
refer the readers to [11] and [8] for a deeper presentation of the theory of 
pricing contingent claims in general models. When h is replaced by some 
convex (resp. concave) function, it was shown by El Karoui, Jeanblanc and 
Shreve [6] that the optimal control is u* = ai (resp. u* = 02), and the as- 
sociated hedging strategy is defined by the classical Black-Scholes strategy. 
The above simple model was studied by Avellaneda, Levy and Paras [1]. 
The connection with the hedging problem was analyzed by Cvitanic, Pham 
and Touzi [3] in the context of stochastic volatility models. 

As usual, we introduce the dynamic version of the stochastic control prob- 
lem (5.3): 

(5.4) v{t,x):= sup ^.[hiX'' {T))\X'' {t) = x]. 

Then, it follows from classical techniques that the function v is the unique 
bounded C^{[0,T) x ]R_|_) viscosity solution of the nonlinear partial differen- 
tial equation 

—vt — \x^02vtx + h^'^'^l'^xx — Oil [Oi ^) ^ [Oi 00), w(T, •) = /i; 
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see, for example, [12]. Here subscripts denote partial derivatives. In the 
present context, we shall consider a function h which is neither convex nor 
concave, so that no explicit solution for this PDE is known. 

Remark 5.1. Although more regularity should be expected for the value 
function v because of the uniform parabolicity of the PDE, we do not enter 
this discussion since we only need the continuity property. 

5.2. Maturity randomization. Let {C^)k>o be a sequence of independent 
random variables in with exponential distribution 



Set 



so that 



IP[r < i] = 1 - e"* for all A; >1. 



T 

:= for every k<n 

n 



n 
k=l 



-a.s. 



In the present context, the maturity randomization algorithm (3.3)-(3.4) 
translates to the sequence of stochastic control problems 

v^{x) = h{x) 

and, for all k <n — 1: 

vi+\x):= sup nvi{X%Q~^))\X-{t)=x] 
i/eW(F) 



sup E 







oo 

v'^.iX" {t))\ne~^"Ut X''(t)=x 



where A„ := n/T. The corresponding Hamilton- J acobi-Bellman equation is 
given by the ordinary differential equation (ODE) 

(5.5) - \x^<yl[{vi^'U]-^ + \x^ol[{vt+%.]- + K{vi^' - vi) = 0. 
An immediate induction argument shows that for each l<k<n 

(5.6) is nonnegative, bounded, and satisfies f^(0) = 0, 

which provides the appropriate boundary condition for the above ODE. 

We conclude this section by discussing the convergence of the maturity 
randomizing algorithm in this context, that is, 

(5.7) hm <(X(0)) = ^;(0,X(0)). 
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Let {V;^^^) be defined as in Section 3: 



■ ess-sup A„E 



t>0,k<n-l. 



so that, by the Markov feature of X'^ , 



l<k<n. 



Clearly, assumption (HY) holds since h is bounded. The above identity shows 
that assumption (HV) holds too. 

We finally discuss conditions (3.8) and (3.9): 

1. If h is continuous, one deduces the a.s. continuity of 1 1-^ h(X'^{t)) by us- 
ing the bounds (5.1). Since h is bounded, it follows that t K[h{X'^ (t))] 
is continuous too, that is, (3.8) holds. 

2a. In the case where h is Lipschitz continuous, (3.9) is deduced from the 
bounds of (5.1) and standard estimates on the diffusion process. 

2b. In the case where h is not Lipschitz continuous, we can use the fact 
that, as already noticed at the end of Section 5.1, the value function v 
defined in (5.4) is continuous on [0,T) x (0,oo). Since 

v{e,x)= sup EihiX^iT -e))\X''{0) = x] for < e < T, 

it follows from the homogeneity of the process X'^ that 
1 1 



sup E[h{X''{t))\X''{0) = x] 



is continuous. 



5.3. Explicit solution of the infinite horizon problems. In this section we 
fix n > 1 and derive an explicit formula for the value function w^"*"^ in terms 
of when the payoff function h satisfies the following conditions: 

(5.8) 

(5.9) 

and 



h{x) = I - h{x-^) 



h is continuous, 
: 0; < a; < for some xq £ (0, 1), 



(5.10) 



h is convex on [0,6o], concave on [69,00) 

for some xq <bo < xo~^. 
Notice that the above conditions imply that h is nondecreasing on M+. 
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In order to derive an explicit expression of u^"^^ in terms of v^, we shall 
exhibit a smooth solution U^~^^ of (5.5) which satisfies the properties (5.6). 
We then show that U^^^ = v^'^^ by a classical verification argument. 

In view of the particular form of the function h, a bounded solution C/'^"'"^ 
of (5.5) satisfying U''^^{0) =0 will be obtained under the additional guess 
that 



(5.11) 



U^;^^{x)>0 if and only if X < 



for some b^+i > to be determined. Then, the ODE (5.5) reduces to 



(5.12) 
(5.13) 



k+l _ jjk\ 



for X < bk+i, 
for X > 



2 ~ 1 " XX ' rp * 

The solutions of (5.12) and (5.13) can be characterized by solving the as- 
sociated homogeneous equations, and then applying the constants variation 
technique. Bounded solutions of (5.12) and (5.13) are then seen to be of the 
form 



(5.14) 
where 



U^+^{x) 



{a\+^[x)x'^\ 
\At'\x)xi^, 



for X > bk+i, 
for X < bk+i, 



'1 + 



1 



and 72:=2 1 + + 



8n 
T^2 



We now plug (5.14) into (5.12)-(5.13). After some calculations, this leads to 



^ri(x)=7.(l-7.) 



1,2, 



where Xj > 0, 



fc+i 



1,2, are constants to be fixed later on. By (5.14), 



this provides the candidate solution of (5.12)-(5.13): 



■>k+l 



bk 



+1 



71 



72 



bk^ 



where, for a function ip : ] 



bk+i 
we denote 



bk+i 

/ X 
\bk+i 



1-71 

X > 6fc+i, 

1-72 

X < bk+1, 



(5.15) 



HMix)■.= l^{l-7^) / r 



(f{bs)s'~'^ "^dsdr. 
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In order to determine the constants x,-,a 



fc+l /ofc+l 



fit 



1,2, we now impose 



the restrictions of boundedness and nullity at zero: 

(5.16) limsupf/''+^(x) = limsupFfe\,^jC/'=](2;)x^i +a^+^x^-^i < oo, 

X y oo X /"oo 

(5.17) lim U^+^is) = lim [C/'^lx^^ + a^+^x^-^^ ^ q, 

the continuity condition at the point x = 

(5.18) + aj+^ = /32^+^ + 
and the smooth-fit condition at the point x = 

/3t+Si + {Hl^^ [C/^1}'(1) + a^^(l - 7i) 



(5.19) 



k^^|| 



Since 1 — 71 > and 1 — 72 < 0, it follows from the boundedness of that 
Hl^^^ \U^] is well defined with 

(5.20) xi = 00 and X2 = 0. 

We then conclude from (5.16)-(5.17) that 
(5.21) 

Using (5.18) and (5.19), it follows that 



k+l k+l n 

Qi = a2 =U. 



(5.22) = /32^+i = P[U\hk+i) where /?[(^](6) := 



(p{br)f{r) dr 



for any bounded function 99 : 
1 



i, and 



72 - 71 

For later use, we observe that 



[72(72 - l)r^'-'lo<r<i +71(71 - l)r^^-'lr>i]. 



POO 

f>0 on (0,00) and / f{r)dr = l, 

Jo 

so that / is a density function. In view of these results, we introduce the 
following notation. For a function ip and some real constant 6 > 0, we set 



(5.23) Tb[^]{x) :-- 



71 



72 



for X > b, 
for X <b, 



P[^]{b) + H^,[y,]\ 

so that our candidate solution can be written in the compact form 
(5.24) U''+^ = n^^, [U^] for some fe^+i > 0. 



22 



B. BOUCHARD, N. EL KAROUI AND N. TOUZI 



Remark 5.2. Let ([/'') be a sequence defined as above with = h 
satisfying (5.8), (5.9) and (5.10). As already observed, is nondecreasing 
and therefore nonnegative. As it is positive on some open set, one easily 
checks that U^{x) > for all j; > and fc > 1 by using an inductive argument. 
Indeed, if U'^ is nonnegative, then Hl^^^ [U^] > 0, i = 1, 2. If it is also positive 

on an open set, then /3[[/'^](6fc_|_i) > whenever bk-{-i > 0. 

In order to fix the parameters bk+i, we observe that if U^^^ is convex 
on [0,6fc-)_i] and concave on [bk+i,oo), then it follows from (5.12)-(5.13) 
that ?7'^+-'^(6fc+i) = [/''"(^fc+i)- III view of (5.22), this provides the additional 
equation: 

Our next results show that this condition defines uniquely the sequence of 
positive parameters 6^. 

Lemma 5.1. Let ip:M.^ — > [0,1] be a function satisfying 

(5.25) ip{x) '^oo ^ — CLix'^'^ {In x)^^ and ip{x) '-^q a2x'^^{lnx)^'^ , 

for some positive constants a\,a2 and some integer 6i,52- Then there is a 
positive solution to the equation I3[ip\{b) =ip{b), and 

r6[99](j;)~^l-a;xi'Hlnx)'^'i and Ti:[ip\{x) a'^x^'^^ilnxf^ 

for some positive constants a'^^^a^ and some integer 6'i^5'2. 

Proof. By the expression of the density /, it follows from a trivial 
change of variable that 

/;[(^](6) = ^^^^^~^^ bi-72 /\72-2^(^)^^ 

(5.26) 



llhl^b'-.. rr^^-\i^r)dr. 
72 - 71 Jb 



72 -71 

Using the estimates of the lemma, we then compute that 

(iW\{b) ~o ^) fci-72 [\^^-^a2r^^(lnr)^' dr 

72 - 71 h 

71(71 ~ 1 ) ;.1-71 /''^„7l-2„ „72n„„N(52 
72 - 71 



^ 71(71 1)51-71 r r^^-'^a2r^^{\nrf^ dr + 0{b^-^^' 

72 - 71 



026^2 (In 6) 



52 



72(72 - 1) 



.(72 - 71) (272 - 1) 
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S2 



1 + 



(72 -7i)(7i +72-1) 
72(72 - 1) 



+ 0(6 



1-71' 



(272 - 1)(1 -71 -72) 



where the last equivalence follows from the fact that 72 < 1 — 7i- From this, 
we conclude that 



(5.27) 



lim 



1 + 



72(72 - 1) 



b\o ip{b) (272 - 1)(1 -71 -72; 

Next, since / is a density, we have 



> 1. 



1 - p[^]{b) = 11 61-72 



72 -71 



f.12 '^^i — (^(r)] dr 



^ 7i(7^J) rr^i-2[l-^(r)]dr. 

72 - 71 Jb 

By similar calculations, it follows from the estimate of the lemma that 



(5.28) 



lim — — — = 00. 

byoo 1 — ip[b) 



Now recall that is continuous and bounded. Then (3[ip] is continuous, and 
the existence of a positive solution to the equation /3[(/?](6) = ip{b) follows 
from (5.27) and (5.28). 

The estimates on Tb[{p] are deduced from (5.25) by similar arguments. □ 

Remark 5.3. The statement of Lemma 5.1 is valid for (p = h. Indeed, 
one can check that the above existence argument goes through under the 
condition (5.9) instead of (5.25). 



Lemma 5.2. Let 93:M+ — > [0, 1] be a nondecreasing function satisfying 

(5.29) (^(0) = 1 - 99(00) = 
such that 

(5.30) if is convex on [0,6*], concave on [b*,oo) for some 6* > 
and either: 

(i) there is some e > such that (p{b) = for all b<e, or 

(ii) if is strictly convex on a neighborhood ofO. 

Then, there is at most one positive solution to the equation P[ip](b) =ip{b). 
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Proof. Observe from (5.26) that the function [3[ip\ is differentiable. 
From the convexity /concavity condition on it follows that ip is differen- 
tiable a.e. on M_|_, its subgradient (9_(/? is nonempty (resp. empty) in the 
domain of convexity (resp. concavity), and its supergradient 5+ 93 is empty 
(resp. nonempty) in the domain of convexity (resp. concavity). Set d{p := 

In order to prove the required result, it suffices to show that 
for all 6>0:/3[(/j](6) = 99(6) =^ V/3M(6)-p<0 

(5.31) 

for any p G dip{h). 

Recall that ip{Q) = 1 — '^{00) = by (5.29), and that tp is nondecreasing, 
continuous on [6*, cxo). Since / is density, it follows from (5.22) that /3[99](6) > 
whenever 6 > 0, and therefore 

(5.32) = (/?(0) < ip{b) < ip{oo) = 1 whenever P[ip] (5) = ip{b) with b>0. 
With the help of (5.26), we next compute that 

V/9[(/7] (6) = 6-^1 (/?(6) + 71(71 -1)6-Ti / v3(r)r^i~2dr 

Jb 

+ 6-^1 -72)(/3M -</')(&). 
Integrating by parts the integral on the right-hand side, we see that 

Jb 

so that 

(5.33) V/3M(6) = -7i6~^M ip' {r)r^^-^ dr whenever /3[^] (6) = (/?(6). 

Jb 

Similar computations provide the following alternative expression of the gra- 
dient: 

fb 

(5.34) V/3[(^](6) =726"'^M (^'(r)r'^2"i dr whenever P[(p]{b) = (p{b) . 

Jo 

We now consider two cases: 

1. Suppose that b >b* and choose an arbitrary p G dip{b). The fact that 
is concave nondecreasing on 00) implies that < 'p'{r) <p for a.e. 
r > 6. If (p'{r) = p for a.e. r > 6, we end up with a contradiction to (5.32). 
Hence, there is a subset of [b, 00) of positive measure on which (p'{r) < p 
a.e. Together with (5.33) and the fact that 71 < 0, this implies that 

V (3[ip]{b) < —jib~'^^p r'^^~^dr=p for any p G d(p{b) . 
Jb 

Hence (5.31) holds in this case. 
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2. If b < b* , we repeat the same argument as in the first case using the 
representation (5.34), and we show that (5.31) also holds in this case. D 

We are now in a position to define our candidate solution of the nonlinear 
ODE (5.5). 

Proposition 5.1. There exists a sequence of functions {U^)Q<k<n de- 
fined by 

(5.35) C/° = /i and U^+^ =n^^^[U% 
where the sequence (bk)k>i is uniquely defined by 

(5.36) P[U\bk+i) = U\bk+i). 

so that U^^'^ solves (5.12)-(5.13). Moreover, for all k>l: 

(i) is strictly convex (resp. strictly concave) on (0,6fc) [resp. {bk,oo)], 

(ii) {bk-x){U'' -U''-^){x) > for all xG{0,oo)\ {bk}, 

(iii) is a strictly increasing function with values in [0,1), 

(iv) U^{x) ~oo 1 — aj^x'^'i (Inx)*^! and U^{x) ~o al^'''^ (lnx)''2 ^ for some 
constants 0^,02 and some integer iJf^jJf- 

Proof. 1. The existence and uniqueness of the sequence (C/'^) associated 
to the sequence {b^) follow from Lemmas 5.1 and 5.2, together with Remark 
5.3, by a direct induction argument. The fact that U^^^ solves (5.12)-(5.13) 
has been shown in the discussion preceding Lemma 5.1. 

2. Item (iv) is then obtained by induction as a by-product of Lemma 5.1 
and Remark 5.3. In view of (5.12)-(5.13), item (i) is a direct consequence 
of (ii). Also, C/'^ is by construction, and the remaining part of item (iii) 
follows from (i), (iv) and an induction. 

3. It only remains to prove item (ii). Clearly, it is sufficent to show that, 
for any x > 0, 

{U^y{x)-p<0 foT all p e dU''-\x) 

(5.37) 

whenever U (x) = U (x), 

where we use the notation of Lemma 5.2. Indeed, this implies that C/'^"^ and 
intersect at a unique point, which is already known to be 6^, and the re- 
quired inequality follows. The reason for introducing the notation dU^~^{x) 
comes from the fact that, for k = l, = h may be nonsmooth although h' 
is defined a.e. by (5.10). Let x > be such that U^{x) = U^~^{x) and set i 
:= 2 if X < bk and i := 1 otherwise. From the expression of in terms of 
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C/*^"^, we directly compute that 



X Jxi 



by first integrating by parts and then using the assumption [x) = ^ {x) 
3a. We first assume that x <bk, so that the above identity reads 

(5.38) {U'^Yix) = r {U^-^Y{r)r^''-^ dr. 



Fix p G dU^ ^{x). li X < bk~i, we deduce from the convexity of ^ on 
[0,bk-i] that (C/*--i)'(r) < p for a.e. r<x. Since C/^^-^O) = and x > 
implies U^{x) > by Remark 5.2, it follows from the nondecreasing feature 
of U^~^, see (iii) and the remark just after (5.10), that {U''~^y (r) <p a.e. 
on a subset of [0,x] of positive measure. As 72 > 0, we deduce from (5.38) 
that 

{u'nx)<p 

which is the required result. 

If X G (6fc_i,6fc], then (5.38) can be written as 

{U^y(x)=x~^''j2 C\U^^^Y {r)r^^^^ dr - x~"<''-i2 t\u^^^Y {r)r^^^^ dr. 



By (5.36) and the identity (5.34) derived in the proof of Lemma 5.2, we 
obtain 

{U^Y (^x) = iy^yj V [i[U^~\bk) - x-^^-f2 j {U^-^}'{r)r^^-^dr. 

Since x > bk-i, we deduce from the concavity of C/'^~^ on [bk-i, 00) 3 b^ that 
for p£dU^-^{bk) 

-72 , ^ fbk 



/ r \ ~ '2 r"k 
{U'y{x)<^-j VP[U^-\bu)-x~^-^2P r^'-^dr 

72 

Vf3[U^-\bk)-p 

<{£)~'\'^m''-\K)-p\+p. 
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Recalling the assertion (5.31) which was derived in the proof of Lemma 
5.2, we deduce that — p <0 which concludes the proof in the case 

X < bk- 

3b. The case x > 6^ is treated similarly. Equation (5.38) is replaced by 



{[/'=}'(x) = / {u^Yiry 

J 00 

and we use (5.33) instead of (5.34). □ 



dr 



Our final result shows that the sequence {U^)k<n constructed in the above 
proposition corresponds to {v^)k<n- 



Proposition 5.2. Let {U'^) 

k<n be the sequence of functions defined in 

Proposition 5.1. Then, for each k>l, C/* 



Proof. Since = h, it suffices to show that for all x > and A; > 



U^+^{x)= sup E 



;7fc(X^(t)) Je-("/^)*dt X''{0) = x 



Let > be fixed. We first deduce from Proposition 5.1 that U^~^^ is a 
classical solution of 

-\-'4[U'jr + \x'af[U'jr + ^iU''+' -U') = on [0, oc). 
Since ai <(T2, the above ODE can be written as 



(5.39) 



sup lxWJ' + ^u>' = ^u>^+' 



on [0,00). 



Recalling from Proposition 5.1 that \J^^^ is C^, we then deduce from Ito's 
lemma that, for all x > 0, v E IA{¥') and all stopping time r. 



[/^■+^(x) >E 



e-("/^)"[/'=+^(X^(r))+ / ■ U\X''{t))^e-^''/^^'dt X''{0)=x 



Since and U^~^^ are bounded, it follows from the dominated convergence 
theorem that 



U''+\x)>E 



(5.40) 



/ C/'=(X'^(t))^e-("/^)*dt X^(0) 
Jo T 



for all u£U(¥). 



On the other hand, we deduce from (5.39) and Ito's lemma that for i) G 
U{¥) defined by 
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we have, for all stopping time r, 

L Jo T 

Since U^^^ and are bounded, we obtain by sending r — > oo that 

which, combined with (5.40), concludes the proof. □ 



oo . . 







Remark 5.4. Condition (5.9) can be clearly relaxed by only assuming 
that the payoff function satisfies the estimates (5.25) at infinity and the ori- 
gin. We refrained from starting with such conditions because the parameters 
7i and 72 arise along our analysis. Similarly, all our analysis goes through 
under the condition that h is bounded, not necessarily lying in the interval 
[0,1]. 

Remark 5.5. Throughout this example, we assumed that the payoff 
function h is continuous, excluding some important example in finance. The 
only place where this assumption was used is the proof Lemma 5.1 and 
to derive the continuity properties (3.8)-(3.9) of Corollary 3.1. Notice that 
some cases where h is not continuous can be handled. Consider, for instance, 
the digital option example: 

h{x) := l[i.oo)(2;) for all x>0. 
We directly compute that 

U\x) := Ti[h]{x) = [1 - (1 - /3i)x^i]l[i,^)(x) + Ax^21[o,i)(^). 

where 

71 



/3i 



71 - 72 



When h is continuous and satisfies the requirements of Lemmas 5.1 and 
5.2, the constant bi is the unique solution of the equation U^{bi) = h{bi). 
In the above case of the digital option, notice that /i(l) = 1 and U^{bi) = 
/?! 7^ 1. In particular, is not a function in this case. 

Clearly, the above function is a bounded smooth solution of boths 
ODEs (5.12) and (5.13), and satisfies property (i) of Proposition 5.1. Al- 
though is not at the point bi = 1, the proof of Proposition 5.2 is still 
valid under the above properties, since Ito's lemma holds for the function 
UK Hence = v^. 

Observe that satisfies (5.25) of Lemma 5.1, and therefore Propositions 
5.1 and 5.2 can be applied to the sequence (^7^^) started from k = 2. 
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By the same reasoning as in 2b in the discussion at the end of Section 
5.2, the mapping 

sup E{h{X''{t))\X''{0)=x] 

is continuous. For v £U{¥), we have u > ai > P-a.s., so that X'^ is uni- 
formly elhptic. This imphes that 

t ^ E[h{X''{t))\X''{0) = x]= F[X''{t) > 1] 

is also continuous. Hence Conditions (3.8) and (3.9) of Corollary 3.1 hold 
for this case. 

5.4. A numerical example. In this section we use the maturity random- 
ization algorithm to approximate the value function v defined in (5.3). We 
consider the same model as in Section 5.1 with 

(5.41) ai=0 and h{x) = lx>K 

for some real parameter K > 0. The reasons for considering this particular 
case are: 

1. The value function v can be computed explicitly, up to a simple numerical 
integration. This will allow us to test our numerical results. 

2. Although o"! = 0, the reasoning of Section 5.3 is easily adapted to this 
context. 

Proposition 5.3. In the context of (5.41), the value function v is given 

by 



v{0, x) = w{0, x) 

rm{x) 



e 

oo 



-2m(x)(m(x)-r)/(<x2T) j^^^^ ^ FT(m(2;)) 



where m{x) ■.= ln{K/x) and 
f^(r) := ^e(-i/(2-i^))(-+(V2Hr)^ ^nd Ft{x) := H frir) dr. 

Furthermore, for every x>0, the optimal control associated to v{0,x) is 
given by 

Mt) = (T2lt<Tx, te[0,T], 

where 

Tx ■.= T Amf{t>0:-^alt + a2Wt>ln{K/x)}. 



30 



B. BOUCHARD, N. EL KAROUI AND N. TOUZI 

Table 1 





K = 


100, a; 


= 95, T 


= 0.5 






K = 


100, a; 


= 95,T = 1 




(T2\n 


10 


200 


500 


1000 


Exact 


(T2\n 


10 


200 


500 1000 


Exact 


0.2 
0.4 
0.6 


0.6884 
0.8279 
0.8754 


0.6978 
0.8330 
0.8789 


0.6981 
0.8332 
0.8790 


0.6982 
0.8333 
0.8790 


0.6982 
0.8333 
0.8791 


0.2 
0.4 
0.6 


0.7693 
0.8697 
0.9030 


0.7763 
0.8734 
0.9055 


0.7765 0.7766 
0.8735 0.8735 
0.9056 0.9056 


0.7767 
0.8736 
0.9056 



Proof. Clearly w is continuous on [0,r] x [0,oo) and C^'^ on [0,r] x 
[0, A']. Then, standard arguments show that it satisfies 

(5.42) -vt- \alx^n^.^ = on [0, T]x[0,K], 
and satisfies the boundary conditions 

(5.43) v{T,-) = l.>K and v{-,K) = l. 

For ly E U{¥), let X^^ be the solution of (5.2) with initial condition X^^{t) = 
X at time t. Recalling the law of the maximum of a drifted Brownian condi- 
tionally to its terminal value (see, e.g., [7]), we obtain that 

(5.44) w{t,x)=E[hixf:f{4MX^;fit) = x]=F 
where 

h,xis) = cr2ls<rj^^ "^ith ^(s) = <^2, s e [t, T] 
and, for gZ^(F), 

:= inf{t <s<T: Xl,{s) >K}AT. 

It follows that w is nonincreasing in t. Since it solves (5.42), it is convex and 
solves 

(5.45) min -wt - Wx^w^^ = on [0,r] x [0, A]. 

i)<v<cr2 

Fix V € W(F) and observe that, by Ito's lemma, (5.45), (5.43) and definition 

In view of (5.44), this implies that w = v and that the optimal strategy is 
given by h^x- □ 



max X, (s) > K 

t<s<T ' 
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K = 


100, X = 50,T = 


= 1 






(T2\n 


10 


200 


500 




1000 


Exact 


0.4 


5.8058 X 10~^ 


5.7949 X IQ- 


"2 5.7951 X 10" 


-2 


5.7952 X 10^2 


5.7954 X 10-2 






K = 


= 100,x = 80,T = 


1 






0.4 


6.9973 X 10-2 


6.9430 X IQ- 


"2 6.9419 X 10' 


-2 


6.9415 X 10-2 


6.9411 X 10-2 



We next define the sequence of randomized control problems (u^) as in 
Section 5.2. The associated sequence of ODEs is given by 

min -^„^x\v'^-^^),, + Xn{vt^-v^)=0 on[0,K] 

0<u<a2 

with v^ = h and v'^{x) = 1 for x > K. A straightforward adaptation of the 
arguments of Section 5.3 then shows that {v^)k<n is exphcitly given by the 
inductive scheme 



k) 



K 



on [0, K] 



where 72 and are defined as in Section 5.3 for the corresponding value 
of n. 

Condition (5.34) of Corollary 3.1 holds by Proposition 5.3. By Remark 
3.5(ii), it suffices to check (5.33) for the optimal control associated to u(0,x). 
Since this optimal control does not depend on the time horizon T, this 
amounts to checking (5.34). Since assumptions (HY), (HV) and (HZ//) are 
satisfied, the above scheme is consistent. 

In Tables 1 and 2, we report numerical estimates of v obtained by using the 
approximating sequence (f"). The "exact" values of v have been computed 
by numerical integration of the formula reported in Proposition 5.3. 

In Table 1 above, we fix the parameters x, and we explore the per- 
formance of the maturity randomization algorithm for various values of T 
and (72. Our experiments show an excellent performance of the algorithm. 
Notice that we already obtain sharp estimates for a small value of n = 10. 

We next fix the parameter (T2, and vary the values of the parameters 
X and T. We observe again, in Table 2, the algorithm shows an excellent 
performance even for small values of n. 
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